Visual recognition memory of scenes is driven by categorical, not sensory, visual representations.

When we perceive a scene, our brain processes various types of visual information simultaneously, ranging from sensory features, such as line orientations and colors, to categorical features, such as objects and their arrangements. Whereas the role of sensory and categorical visual representations in predicting subsequent memory has been studied using isolated objects, their impact on memory for complex scenes remains largely unknown. To address this gap, we conducted an fMRI study in which female and male participants encoded pictures of familiar scenes (e.g., an airport picture) and later recalled them, while rating the vividness of their visual recall. Outside the scanner, participants had to distinguish each seen scene (e.g., an airport picture) from three similar lures (e.g., 3 airport pictures). We modeled the sensory and categorical visual features of multiple scenes using both early and late layers of a deep convolutional neural network. Then, we applied representational similarity analysis to determine which brain regions represented stimuli in accordance with the sensory and categorical models. We found that categorical, but not sensory, representations predicted subsequent memory. In line with the previous result, only for the categorical model, the average recognition performance of each scene exhibited a positive correlation with the average visual dissimilarity between the item in question and its respective lures. These results strongly suggest that even in memory tests that ostensibly rely solely on visual cues (such as force-choice visual recognition with similar distractors), memory decisions for scenes may be primarily influenced by categorical rather than sensory representations.Significance Statement Our memory for real-world scenes often comprises a tableau of complex visual features, but recent findings challenge the view that our memories of such stimuli rely on purely visual information. Instead, it appears that our memory for scenes is heavily influenced by higher-level categorical information. Analyzing cortical representations in regions responsive to both categorical and sensory features, we discovered that only the former can reliably predict memory outcomes. Moreover, the distinctiveness of scenes in terms of their categoric features among similar examples is positively associated with our ability to accurately recognize previously encountered scenes. In essence, this study sheds light on how our brains rely on categorical information to recognize natural scenes.

Hippocampal Functions Modulate Transfer-Appropriate Cortical Representations Supporting Subsequent Memory.

The hippocampus plays a central role as a coordinate system or index of information stored in neocortical loci. Nonetheless, it remains unclear how hippocampal processes integrate with cortical information to facilitate successful memory encoding. Thus, the goal of the current study was to identify specific hippocampal-cortical interactions that support object encoding. We collected fMRI data while 19 human participants (7 female and 12 male) encoded images of real-world objects and tested their memory for object concepts and image exemplars (i.e., conceptual and perceptual memory). Representational similarity analysis revealed robust representations of visual and semantic information in canonical visual (e.g., occipital cortex) and semantic (e.g., angular gyrus) regions in the cortex, but not in the hippocampus. Critically, hippocampal functions modulated the mnemonic impact of cortical representations that are most pertinent to future memory demands, or transfer-appropriate representations Subsequent perceptual memory was best predicted by the strength of visual representations in ventromedial occipital cortex in coordination with hippocampal activity and pattern information during encoding. In parallel, subsequent conceptual memory was best predicted by the strength of semantic representations in left inferior frontal gyrus and angular gyrus in coordination with either hippocampal activity or semantic representational strength during encoding. We found no evidence for transfer-incongruent hippocampal-cortical interactions supporting subsequent memory (i.e., no hippocampal interactions with cortical visual/semantic representations supported conceptual/perceptual memory). Collectively, these results suggest that diverse hippocampal functions flexibly modulate cortical representations of object properties to satisfy distinct future memory demands.Significance Statement The hippocampus is theorized to index pieces of information stored throughout the cortex to support episodic memory. Yet how hippocampal processes integrate with cortical representation of stimulus information remains unclear. Using fMRI, we examined various forms of hippocampal-cortical interactions during object encoding in relation to subsequent performance on conceptual and perceptual memory tests. Our results revealed novel hippocampal-cortical interactions that utilize semantic and visual representations in transfer-appropriate manners: conceptual memory supported by hippocampal modulation of frontoparietal semantic representations, and perceptual memory supported by hippocampal modulation of occipital visual representations. These findings provide important insights into the neural mechanisms underlying the formation of information-rich episodic memory and underscore the value of studying the flexible interplay between brain regions for complex cognition.

Network-level dynamics underlying a combined rTMS and psychotherapy treatment for major depressive disorder: An exploratory network analysis

Background: Despite the growing use of repetitive transcranial magnetic stimulation (rTMS) as a treatment for depression, there is a limited understanding of the mechanisms of action and how potential treatment-related brain changes help to characterize treatment response. To address this gap in understanding we investigated the effects of an approach combining rTMS with simultaneous psychotherapy on global functional connectivity. Method: We compared task-related functional connectomes based on an idiographic goal priming task tied to emotional regulation acquired before and after simultaneous rTMS/psychotherapy treatment for patients with major depressive disorders and compared these changes to normative connectivity patterns from a set of healthy volunteers (HV) performing the same task. Results: At baseline, compared to HVs, patients demonstrated hyperconnectivity of the DMN, cerebellum and limbic system, and hypoconnectivity of the fronto-parietal dorsal-attention network and visual cortex. Simultaneous rTMS/psychotherapy helped to normalize these differences, which were reduced after treatment. This finding suggests that the rTMS/therapy treatment regularizes connectivity patterns in both hyperactive and hypoactive brain networks. Conclusions: These results help to link treatment to a comprehensive model of the neurocircuitry underlying depression and pave the way for future studies using network-guided principles to significantly improve rTMS efficacy for depression. (AU)

Cognition's dependence on functional network integrity with age is conditional on structural network integrity.

Maintaining good cognitive function is crucial for well-being across the lifespan. We proposed that the degree of cognitive maintenance is determined by the functional interactions within and between large-scale brain networks. Such connectivity can be represented by the white matter architecture of structural brain networks that shape intrinsic neuronal activity into integrated and distributed functional networks. We explored how the function-structure connectivity convergence, and the divergence of functional connectivity from structural connectivity, contribute to the maintenance of cognitive function across the adult lifespan. Multivariate analyses were used to investigate the relationship between function-structure connectivity convergence and divergence with multivariate cognitive profiles, respectively. Cognitive function was increasingly dependent on function-structure connectivity convergence as age increased. The dependency of cognitive function on connectivity was particularly strong for high-order cortical networks and subcortical networks. The results suggest that brain functional network integrity sustains cognitive functions in old age, as a function of the integrity of the brain's structural connectivity.

Network-level dynamics underlying a combined rTMS and psychotherapy treatment for major depressive disorder: An exploratory network analysis.

Background: Despite the growing use of repetitive transcranial magnetic stimulation (rTMS) as a treatment for depression, there is a limited understanding of the mechanisms of action and how potential treatment-related brain changes help to characterize treatment response. To address this gap in understanding we investigated the effects of an approach combining rTMS with simultaneous psychotherapy on global functional connectivity. Method: We compared task-related functional connectomes based on an idiographic goal priming task tied to emotional regulation acquired before and after simultaneous rTMS/psychotherapy treatment for patients with major depressive disorders and compared these changes to normative connectivity patterns from a set of healthy volunteers (HV) performing the same task. Results: At baseline, compared to HVs, patients demonstrated hyperconnectivity of the DMN, cerebellum and limbic system, and hypoconnectivity of the fronto-parietal dorsal-attention network and visual cortex. Simultaneous rTMS/psychotherapy helped to normalize these differences, which were reduced after treatment. This finding suggests that the rTMS/therapy treatment regularizes connectivity patterns in both hyperactive and hypoactive brain networks. Conclusions: These results help to link treatment to a comprehensive model of the neurocircuitry underlying depression and pave the way for future studies using network-guided principles to significantly improve rTMS efficacy for depression.

Episodic Past, Future, and counterfactual thinking in Relapsing-Remitting Multiple sclerosis.

Multiple sclerosis (MS) is a progressive disease characterized by widespread white matter lesions in the brain and spinal cord. In addition to well-characterized motor deficits, MS results in cognitive impairments in several domains, notably in episodic autobiographical memory. Recent studies have also revealed that patients with MS exhibit deficits in episodic future thinking, i.e., our capacity to imagine possible events that may occur in our personal future. Both episodic memory and episodic future thinking have been shown to share cognitive and neural mechanisms with a related kind of hypothetical simulation known as episodic counterfactual thinking: our capacity to imagine alternative ways in which past personal events could have occurred but did not. However, the extent to which episodic counterfactual thinking is affected in MS is still unknown. The current study sought to explore this issue by comparing performance in mental simulation tasks involving either past, future or counterfactual thoughts in relapsing-remitting MS. Diffusion weighted imaging (DWI) measures were also extracted to determine whether changes in structural pathways connecting the brain's default mode network (DMN) would be associated with group differences in task performance. Relative to controls, patients showed marked reductions in the number of internal details across all mental simulations, but no differences in the number of external and semantic-based details. It was also found that, relative to controls, patients with relapsing-remitting MS reported reduced composition ratings for episodic simulations depicting counterfactual events, but not so for actual past or possible future episodes. Additionally, three DWI measures of white matter integrity-fractional anisotropy, radial diffusivity and streamline counts-showed reliable differences between patients with relapsing-remitting MS and matched healthy controls. Importantly, DWI measures associated with reduced white matter integrity in three association tracts on the DMN-the right superior longitudinal fasciculus, the left hippocampal portion of the cingulum and the left inferior longitudinal fasciculus-predicted reductions in the number of internal details during episodic counterfactual simulations. Taken together, these results help to illuminate impairments in episodic simulation in relapsing-remitting MS and show, for the first time, a differential association between white matter integrity and deficits in episodic counterfactual thinking in individuals with relapsing-remitting MS.

Using diffusion tensor imaging to effectively target TMS to deep brain structures.

TMS has become a powerful tool to explore cortical function, and in parallel has proven promising in the development of therapies for various psychiatric and neurological disorders. Unfortunately, much of the inference of the direct effects of TMS has been assumed to be limited to the area a few centimeters beneath the scalp, though clearly more distant regions are likely to be influenced by structurally connected stimulation sites. In this study, we sought to develop a novel paradigm to individualize TMS coil placement to non-invasively achieve activation of specific deep brain targets of relevance to the treatment of psychiatric disorders. In ten subjects, structural diffusion imaging tractography data were used to identify an accessible cortical target in the right frontal pole that demonstrated both anatomic and functional connectivity to right Brodmann area 25 (BA25). Concurrent TMS-fMRI interleaving was used with a series of single, interleaved TMS pulses applied to the right frontal pole at four intensity levels ranging from 80% to 140% of motor threshold. In nine of ten subjects, TMS to the individualized frontal pole sites resulted in significant linear increase in BOLD activation of BA25 with increasing TMS intensity. The reliable activation of BA25 in a dosage-dependent manner suggests the possibility that the careful combination of imaging with TMS can make use of network properties to help overcome depth limitations and allow noninvasive brain stimulation to influence deep brain structures.

Network-based rTMS to modulate working memory: The difficult choice of effective parameters for online interventions.

BACKGROUND: Online repetitive transcranialmagnetic stimulation (rTMS) has been shown to modulate working memory (WM) performance in a site-specific manner, with behavioral improvements due to stimulation of the dorsolateral prefrontal cortex (DLPFC), and impairment from stimulation to the lateral parietal cortex (LPC). Neurobehavioral studies have demonstrated that subprocesses of WM allowing for the maintenance and manipulation of information in the mind involve unique cortical networks. Despite promising evidence of modulatory effects of rTMS on WM, no studies have yet demonstrated distinct modulatory control of these two subprocesses. The current study therefore sought to explore this possibility through site-specific stimulation during an online task invoking both skills. METHODS: Twenty-nine subjects completed a 4-day protocol, in which active or sham 5Hz rTMS was applied over the DLPFC and LPC in separate blocks of trials while participants performed tasks that required either maintenance alone, or both maintenance and manipulation (alphabetization) of information. Stimulation targets were defined individually based on fMRI activation and structural network properties. Stimulation amplitude was adjusted using electric field modeling to equate induced current in the target region across participants. RESULTS: Despite the use of advanced techniques, no significant differences or interactions between active and sham stimulation were found. Exploratory analyses testing stimulation amplitude, fMRI activation, and modal controllability showed nonsignificant but interesting trends with rTMS effects. CONCLUSION: While this study did not reveal any significant behavioral changes in WM, the results may point to parameters that contribute to positive effects, such as stimulation amplitude and functional activation.

Neural signatures of saliency-mapping in anhedonia: A narrative review.

Anhedonia is the loss of pleasure or motivation to engage in previously enjoyable activities, and is a transdiagnostic symptom associated with significant clinical impairment. Anhedonia is implicated in several different psychiatric disorders, presenting a promising opportunity for transdiagnostic treatment. Thus, developing targeted treatments for anhedonia is of critical importance for population mental health. An important first step in doing so is establishing a thorough understanding of the neural correlates of anhedonia. The Triple Network Model of Psychopathology provides a frame for how brain activity may go awry in anhedonia, specifically in the context of Salience Network (SN) function (i.e., saliency-mapping). We present a narrative review examining saliency-mapping as it relates to anhedonia severity in depressed and transdiagnostic adult samples. Results revealed increased anhedonia to be associated with hyperactivity of the SN at rest and in the context of negative stimuli, as well as a global lack of SN engagement in the context of positive stimuli. Potential treatments for anhedonia are placed within this model, and future directions for research are discussed.

Human immunodeficiency virus-related decreases in corpus callosal integrity and corresponding increases in functional connectivity.

People living with human immunodeficiency virus (PLWH) often have neurocognitive impairment. However, findings on HIV-related differences in brain network function underlying these impairments are inconsistent. One principle frequently absent from these reports is that brain function is largely emergent from brain structure. PLWH commonly have degraded white matter; we hypothesized that functional communities connected by degraded white matter tracts would show abnormal functional connectivity. We measured white matter integrity in 69 PLWH and 67 controls using fractional anisotropy (FA) in 24 intracerebral white matter tracts. Then, among tracts with degraded FA, we identified gray matter regions connected to these tracts and measured their functional connectivity during rest. Finally, we identified cognitive impairment related to these structural and functional connectivity systems. We found HIV-related decreased FA in the corpus callosum body (CCb), which coordinates activity between the left and right hemispheres, and corresponding increases in functional connectivity. Finally, we found that individuals with impaired cognitive functioning have lower CCb FA and higher CCb functional connectivity. This result clarifies the functional relevance of the corpus callosum in HIV and provides a framework in which abnormal brain function can be understood in the context of abnormal brain structure, which may both contribute to cognitive impairment.

Age-related dedifferentiation and hyperdifferentiation of perceptual and mnemonic representations.

Preliminary evidence indicates that occipito-temporal activation patterns for different visual stimuli are less distinct in older (OAs) than younger (YAs) adults, suggesting a dedifferentiation of visual representations with aging. Yet, it is unclear if this deficit (1) affects only sensory or also categorical aspects of representations during visual perception (perceptual representations), and (2) affects only perceptual or also mnemonic representations. To investigate these issues, we fMRI-scanned YAs and OAs viewing and then remembering visual scenes. First, using representational similarity analyses, we distinguished sensory vs. categorical features of perceptual representations. We found that, compared to YAs, sensory features in early visual cortex were less differentiated in OAs (i.e., age-related dedifferentiation), replicating previous research, whereas categorical features in anterior temporal lobe (ATL) were more differentiated in OAs. This is, to our knowledge, the first report of an age-related hyperdifferentiation. Second, we assessed the quality of mnemonic representations by measuring encoding-retrieval similarity (ERS) in activation patterns. We found that aging impaired mnemonic representations in early visual cortex and hippocampus but enhanced mnemonic representations in ATL. Thus, both perceptual and mnemonic representations in ATL were enhanced by aging. In sum, our findings suggest that aging impairs visual and mnemonic representations in posterior brain regions but enhances them in anterior regions.

Mapping the organization and dynamics of the posterior medial network during movie watching.

Brain regions within a posterior medial network (PMN) are characterized by sensitivity to episodic tasks, and they also demonstrate strong functional connectivity as part of the default network. Despite its cohesive structure, delineating the intranetwork organization and functional diversity of the PMN is crucial for understanding its contributions to multidimensional event cognition. Here, we probed functional connectivity of the PMN during movie watching to identify its pattern of connections and subnetwork functions in a split-sample replication of 136 participants. Consistent with prior findings of default network fractionation, we identified distinct PMN subsystems: a Ventral PM subsystem (retrosplenial cortex, parahippocampal cortex, posterior angular gyrus) and a Dorsal PM subsystem (medial prefrontal cortex, hippocampus, precuneus, posterior cingulate cortex, anterior angular gyrus). Ventral and Dorsal PM subsystems were differentiated by functional connectivity with parahippocampal cortex and precuneus and integrated by retrosplenial cortex and posterior cingulate cortex, respectively. Finally, the distinction between PMN subsystems is functionally relevant: whereas both Dorsal and Ventral PM connectivity tracked the movie content, only Ventral PM connections increased in strength at event transitions and appeared sensitive to episodic memory. Overall, these findings reveal PMN functional pathways and the distinct functional roles of intranetwork subsystems during event cognition.

The Effects of Functionally Guided, Connectivity-Based rTMS on Amygdala Activation.

While repetitive transcranial magnetic stimulation (rTMS) is widely used to treat psychiatric disorders, innovations are needed to improve its efficacy. An important limitation is that while psychiatric disorders are associated with fronto-limbic dysregulation, rTMS does not have sufficient depth penetration to modulate affected subcortical structures. Recent advances in task-related functional connectivity provide a means to better link superficial and deeper cortical sources with the possibility of increasing fronto-limbic modulation to induce stronger therapeutic effects. The objective of this pilot study was to test whether task-related, connectivity-based rTMS could modulate amygdala activation through its connectivity with the medial prefrontal cortex (mPFC). fMRI was collected to identify a node in the mPFC showing the strongest connectivity with the amygdala, as defined by psychophysiological interaction analysis. To promote Hebbian-like plasticity, and potentially stronger modulation, 5 Hz rTMS was applied while participants viewed frightening video-clips that engaged the fronto-limbic network. Significant increases in both the mPFC and amygdala were found for active rTMS compared to sham, offering promising preliminary evidence that functional connectivity-based targeting may provide a useful approach to treat network dysregulation. Further research is needed to better understand connectivity influences on rTMS effects to leverage this information to improve therapeutic applications.

Cerebral white matter connectivity, cognition, and age-related macular degeneration.

Age-related macular degeneration (AMD) is a common retina disease associated with cognitive impairment in older adults. The mechanism(s) that account for the link between AMD and cognitive decline remain unclear. Here we aim to shed light on this issue by investigating whether relationships between cognition and white matter in the brain differ by AMD status. In a direct group comparison of brain connectometry maps from diffusion weighted images, AMD patients showed significantly weaker quantitative anisotropy (QA) than healthy controls, predominantly in the splenium and left optic radiation. The QA of these tracts, however, did not correlate with the visual acuity measure, indicating that this group effect is not directly driven by visual loss. The AMD and control groups did not differ significantly in cognitive performance.Across all participants, better cognitive performance (e.g. verbal fluency) is associated with stronger connectivity strength in white matter tracts including the splenium and the left inferior fronto-occipital fasciculus/inferior longitudinal fasciculus. However, there were significant interactions between group and cognitive performance (verbal fluency, memory), suggesting that the relation between QA and cognitive performance was weaker in AMD patients than in controls.This may be explained by unmeasured determinants of performance that are more common or impactful in AMD or by a recruitment bias whereby the AMD group had higher cognitive reserve. In general, our findings suggest that neural degeneration in the brain might occur in parallel to AMD in the eyes, although the participants studied here do not (yet) exhibit overt cognitive declines per standard assessments.

The visual and semantic features that predict object memory: Concept property norms for 1,000 object images.

Humans have a remarkable fidelity for visual long-term memory, and yet the composition of these memories is a longstanding debate in cognitive psychology. While much of the work on long-term memory has focused on processes associated with successful encoding and retrieval, more recent work on visual object recognition has developed a focus on the memorability of specific visual stimuli. Such work is engendering a view of object representation as a hierarchical movement from low-level visual representations to higher level categorical organization of conceptual representations. However, studies on object recognition often fail to account for how these high- and low-level features interact to promote distinct forms of memory. Here, we use both visual and semantic factors to investigate their relative contributions to two different forms of memory of everyday objects. We first collected normative visual and semantic feature information on 1,000 object images. We then conducted a memory study where we presented these same images during encoding (picture target) on Day 1, and then either a Lexical (lexical cue) or Visual (picture cue) memory test on Day 2. Our findings indicate that: (1) higher level visual factors (via DNNs) and semantic factors (via feature-based statistics) make independent contributions to object memory, (2) semantic information contributes to both true and false memory performance, and (3) factors that predict object memory depend on the type of memory being tested. These findings help to provide a more complete picture of what factors influence object memorability. These data are available online upon publication as a public resource.

Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests.

It is generally assumed that the encoding of a single event generates multiple memory representations, which contribute differently to subsequent episodic memory. We used functional magnetic resonance imaging (fMRI) and representational similarity analysis to examine how visual and semantic representations predicted subsequent memory for single item encoding (e.g., seeing an orange). Three levels of visual representations corresponding to early, middle, and late visual processing stages were based on a deep neural network. Three levels of semantic representations were based on normative observed ("is round"), taxonomic ("is a fruit"), and encyclopedic features ("is sweet"). We identified brain regions where each representation type predicted later perceptual memory, conceptual memory, or both (general memory). Participants encoded objects during fMRI, and then completed both a word-based conceptual and picture-based perceptual memory test. Visual representations predicted subsequent perceptual memory in visual cortices, but also facilitated conceptual and general memory in more anterior regions. Semantic representations, in turn, predicted perceptual memory in visual cortex, conceptual memory in the perirhinal and inferior prefrontal cortex, and general memory in the angular gyrus. These results suggest that the contribution of visual and semantic representations to subsequent memory effects depends on a complex interaction between representation, test type, and storage location.

Age-Related Compensatory Reconfiguration of PFC Connections during Episodic Memory Retrieval.

During demanding cognitive tasks, older adults (OAs) frequently show greater prefrontal cortex (PFC) activity than younger adults (YAs). This age-related increase in PFC activity is often associated with enhanced cognitive performance, suggesting functional compensation. However, the brain is a complex network of interconnected regions, and it is unclear how network connectivity of PFC regions differs for OAs versus YAs. To investigate this, we examined the age-related difference on the functional brain networks mediating episodic memory retrieval. YAs and OAs participants encoded and recalled visual scenes, and age-related differences in network topology during memory retrieval were investigated as a function of memory performance. We measured both changes in functional integration and reconfiguration in connectivity patterns. The study yielded three main findings. First, PFC regions were more functionally integrated with the rest of the brain network in OAs. Critically, this age-related increase in PFC integration was associated with better retrieval performance. Second, PFC regions showed stronger performance-related reconfiguration of connectivity patterns in OAs. Finally, the PFC reconfiguration increases in OAs tracked reconfiguration reductions in the medial temporal lobe (MTL)-a core episodic memory region, suggesting that PFC connectivity in OAs may be compensating for MTL deficits.

Intensity- and timing-dependent modulation of motion perception with transcranial magnetic stimulation of visual cortex.

Despite the widespread use of transcranial magnetic stimulation (TMS) in research and clinical care, the dose-response relations and neurophysiological correlates of modulatory effects remain relatively unexplored. To fill this gap, we studied modulation of visual processing as a function of TMS parameters. Our approach combined electroencephalography (EEG) with application of single pulse TMS to visual cortex as participants performed a motion perception task. During each participants' first visit, motion coherence thresholds, 64-channel visual evoked potentials (VEPs), and TMS resting motor thresholds (RMT) were measured. In second and third visits, single pulse TMS was delivered at one of two latencies, either 30 ms before the onset of motion or at the onset latency of the N2 VEP component derived from the first session. TMS was delivered at 0%, 80%, 100%, or 120% of RMT over the site of N2 peak activity, or at 120% over vertex. Behavioral results demonstrated a significant main effect of TMS timing on accuracy, with better performance when TMS was applied at the N2-Onset timing versus Pre-Onset, as well as a significant interaction, indicating that 80% intensity produced higher accuracy than other conditions at the N2-Onset. TMS effects on the P3 VEP showed reduced amplitudes in the 80% Pre-Onset condition, an increase for the 120% N2-Onset condition, and monotonic amplitude scaling with stimulation intensity. The N2 component was not affected by TMS. These findings reveal the influence of TMS intensity and timing on visual perception and electrophysiological responses, with optimal facilitation at stimulation intensities below RMT.